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ABSTRACT 


An algorithm for the solution of sequence~-dependent routing 
problems is presented and programmed in FORTRAN IV for use on digital 
computers. Solutions, computation times and iteration requirements 
are summarized and discussed for eleven test cases. 

With specific modification of the input data, a typical traveling 


salesman closed-loop problem may be solved by the same program. 





i. 


i. 


iV: 


VI. 


vl 


TABLE OF CONTENTS 
INTRODUCTION 
THE ALGORITHM 
PROGRAMMING CONSIDERATIONS 
THE COMPUTER PROGRAM 
TEST PROBLEMS 
A. | SEQUENCE-DEPENDENT PROBLEMS 
B. | TRAVELING SALESMAN PROBLEMS 
COMPUTATIONAL RESULTS 


CONCLUSIONS 


PerEN DIX A: COMPLETE COMPUTER SOLUTION FOR TEST 


PROBLEM NO. TWO 


AEP DIX Bs FYPICAL SOLUTION OUTPUT 


PEEP Pee: COMPOSITION OF COMPUTER CARD DECK 


APPENDIX D: DESCRIPTION OF VARIABLES USED IN 


COMPUTER PROGRAM 


APPENDIX E: COMPUTER PROGRAM 


PEPEN DIX Fs MODIFICATIONS TO COMPUTER PROGRAM 


FOR DYNAMIC STORAGE ALLOCATION 


BIBLIOGRAPHY 


INITIAL DISTRIBUTION LIST 


FORM DD 1473 


17 


Zi 


24 


24 


26 


32 


35 


7 


4] 


42 


45 


60 


67 


68 


69 











BislhiOr SYMBOLS AND ABBREVIATIONS 
X - a subset of all feasible solution vectors 


ry — a subset of X 


Y - the complement of Y with respect to X 
W(X) - a bound on the objective function for all possible solution 
vectors in X 
leg k - one of the sequence of arcs which form a complete route 
(the k-th leg of a route between N nodes is that arc (i,j) which 
is traversed between the k-th-and (k + 1)-st nodes visited 
in sequence on the route) 
arc(i,j) - a directed path from node i to node j 
Ave (a) - the matrix of costs of traversing arc (i,j) on the k-th leg 
J of the route 
k ; : a 
M,. (m..) - the current working matrix of costs of traversing arc (i,j) 
on the k-th leg of route. (Initially M, = AL but My, is 
changed by the operations of the algorithm) 
Ne ae 
g = a. summed over the set of (i, j:k) for committed arcs and legs 
1) 


My. - the reduced form of M,. 


qi, si, 2k) - the reducing constant for M 


kk 
8 oop) - the second smallest element in M,. 
6 (i,j. :k_) = max 6 (i_,j_:k) where k is uncommitted 
a0 0 Ne p p 
x - represents plus infinity as a matrix element 
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PeevRODUC TION 


The algorithm programmed in this thesis, presented by DeHaemer 
[Ref. 1], uses the branch-and-bound technique to find the optimal 
route between N nodes. It determines the beginning and ending nodes 
and passes through each node exactly once. The criterion for optimality 
is to minimize total cost in traversing the (N-1) arcs of the route where 
the cost of traversing each arc is ay) which is a function of the k-th 
position in the sequence of arcs forming the route. 

The purpose of this paper was to construct a computer program 
which would solve the general class of sequence-dependent routing 
problems using the above mentioned algorithm, given the matrices of 
all possible costs for each leg of the route. The difficulty in solving 
this class of problems has been in finding a method of selection of 
tours which avoids evaluation of all the (N-1) | possible tour costs in 
determining an optimal route. 

Although several algorithms for typical traveling salesman 
problems have been proposed and programmed for a computer [Ref. 2], 
this paper presents the first program and results using the algorithm 
presented in the next section. 

The operational results of solving several test problems are 
given along with a discussion of the limitations of the computer program. 
It is assumed that the reader is familiar with the branch-and-bound 
technique. References 1 ae 3 discuss general background of branch- 


and-bound methods. 





nick SEGMENT OF TREE 


W(X) = 


oS: 


os node numbers 


-4 4 e i : 
@ eae W(Y)=12 @) w(¥)=11 Cy) 
W(y)=11 wy)= 13 oe 
=5 : ase 3 
a W(Y)=12 Ww(y)=l 
woi=14z ) 3 @ a @) G 
W(yY)=15 
~6 6 w(y)=14 -8 8 ao 9 W(Y)=13 
W(Y)=13. W(Y)=14. W(Y)=14 
Notation: 


W(X) - a lower bound on objective function for all possible solution vectors, 
attached to base node X of tree 


‘6 - right-hand nodes with notation as follows (i,j:k) (i.e., k-th leg 
Otome as from i to j) 

W(Y) - lower bound associated with node Y 

Y - left-hand nodes with notation as follows (i, j:k) (ives, hth leg 


of route is not from i to j) 
W(yY) - lower bound associated with node Y 


Note: For computer application, right-hand nodes are labeled with 
positive numbers and left-hand nodes are labeled with negative 


Mumbers. 


Figure l] 





iP ALGORTT HM 


The basic method employed by the algorithm is the branch-and- 
bound technique. The set of all possible routes through N nodes is 
broken up into smaller and smaller subsets and a lower bound on the 
cost of the best route in the subset is obtained. The bounds are then 
used as guides in determining further partitions into smaller subsets 
until the algorithm eventually isolates one or more subsets which are 
complete routes whose costs are less than or equal to the lower bounds 
for all other subsets. These routes are then declared optimal. 

The algorithm generates a tree whose nodes represent subsets of 
routes as illustrated in Figure 1. The base node of the tree establishes 
an absolute lower bound on all possible routes. Each branch or segment 
of a branch is a complete route or subset of a complete route respectively. 
An example tree for an entire problem as generated by the computer 
program may be seen in Appendix A. 

it ie assumed that the set of matrices AL can be specified for all 
(N-1) legs of the route. A problem with N nodes requires that (N-1) 
legs of a route be determined. Each leg k of a route is specified as 
being an arc (i,j) which is a directed path from node i to node j. 

The algorithm as used for the computer program is listed here in 
complete detail. The first three test cases in Section V. A. are worked 
out in some detail in Ref. 1 and sufficient background of the algorithm 


may also be found in the same reference. The only nodifications made 


a 








here in this algorithm are in the branching rule of step 8, elaboration 
of step 7 for the computer program, and in the branching to step 7 from 
step 4 when sufficient legs of a route are known so that a complete 
route may be specified. 
The Steps of the Algorithm 
Step 1: 
The initial setup of the algorithm is made as follows: 
i Set AL = M. tereke= 152 4..,{N-1). 
2. X is the set of all possible routes. 
Oe JOC a = 00 and Leg = 0. Z will be the cost of the 
optimal route at the end of the algorithm. 
Step 2: 
Find the minimum element in each matrix and reduce the 
matrices. An absolute lower bound on the cost of all 
tours is found. 
Weebomedenles kk = lo 2,..., (N=1), find i i, and 


k 


eee J 
yp tk) LED BU 


q(t, /i,2k) such that q(i a 


2. Reduce M, to My where m,. = m,. - afi, 3) :k) for 
ail-ini, and k. 

3. Label node X with W(X) = Cae) summed over 
k=1,2...,(N-l). This label is the absolute lower 


bound on the cost of all tours. 
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BLED: 3: 


Choose the subset for the next tree extension as follows: 
1 
ke 
170. jk) = min Mm. . for each k where leg k is 
© ae 
uncommitted. 


2.) 60s, 30k J] max 8 (i_,j _:k) where k ranges over the 
Oo 10 FO : p p 


uncommitted legs. 
Geeetnen Y= i,j -k Jand Y ue jk) are the next 
0:0O O oO! 
branches from X. 
Step 4: 
Label Y by W(Y) = W(X) + 6 (i_,j ik). 
O25 0 
Step ao 
Since an arc is to be committed to a leg, a new set of 


restricted matrices are formed by the following actions: 


i bDelcte M,. 
fe) 


: i xcept row j . 
2. a. Delete all elements in M, Fa e p i 
Oo 


5 IOye ] Coad : 
b elete columns i, an I in wis gee 


acren 5 of the algorithm was accomplished in the computer 
program through the use of the variable matrix ARCCOM and the variable 
DEL which allowed only certain matrices and certain elements in these 
matrices to be considered in the succeeding steps. 


hl 





3. a. Delete all elements in M, 1 except column i 
= O 
O 


b. Delete rows i. andj inM ‘ 
O Oo ko zal 


4. Delete rows i andj _andcolumns i_ andj _ inallM 
Oo Oo Oo Oo Ks 


except in Mk a and wk _q° 


5. Relabel the matrices as M, - 


6. Leg k is now committed to arc (id) : 

7. If (N-3) legs have been committed, go to Step 7. 
Step 6: 

Initiate procedures to determine what the next leg of the 

route should be. 

1. For each k where leg k has not been committed to a 


route, find ive ips and qi, ij ‘kysuch that ai k) = 


k ee 
A ae 

ELTA Se Tee 
i j 


2. Reduce My, to M, for those legs k which are not 


committed and for all i,j of uncommitted arcs where 
ok k 
= =e GA ee ti) 
Te es 


Beeelabel Y by WY) = WO) - > (iy k) summed over k 


e I’ 


for uncommitted legs. 


FZ 





Step ee 
Ascertain whether a route has been determined and if it 
has an upper bound which is equal to or less than 25° 
1. Increment leg by one since a leg has been committed. 
2. If (N-2) legs of route have been committed and W(Y)@ 
Zo! go te Step 10. 
3. If (N-2) legs of route have been committed and W(Y) > 
a5! go to otep 8. 
4. If (N-2) legs of route have not been committed and 
W(Y) & Zo! go to Step 8, substep 4. 
5. If (N-2) legs of route have not been committed and 
W(y) > Zoe GG tO ole plo. 
Step 8: 
Determine the node X from which to branch as follows: 
1. Make the last Y node non-terminal since it is either 
the end of a complete route or the end of a segment of 
a complete route which has a cost which is greater 
than Zo: Therefore, a search of Y nodes for suitable 


branch points must be made. Go to substep 2. 


Nate that when (N-2) legs of route have been committed, the 


last leg is automatically determined and hence computation ends when 
(N-2) legs are known. 


i 





Step 9: 


Set 


Choose the lowest numbered left-branch node with a 
label W(Y) & Z and branch from this node X. Go to 
Step 9. For all Y nodes with labels W(¥) > Ze 
consider them non-terminal since they would all lead 
to higher cost routes. If there is no Y node which is 

a candidate for branching, go to substep 3. 

All nodes have been made non-terminal by substeps 1 
and 2 of this step and hence the optimal route has been 
HOUN Cer LODe 

litewlctep thvee ef Step / was satisfied, make last Y 


node to be the node X from which to branch. Make Y 


node non-terminal and set W(X) = W(Y). Go to Step 3. 


up the cost matrices and label node X as follows: 
Set leg = 0. Then determine number of legs committed 
on limb of tree from which branch is to occur and set 
leg = to the number of Y nodes on the limb. 

= k ade 
Compute g = Dai Stimmedeover therset of (i,):7K) for 

i 
committed arcs and legs at this point in the tree. 
If no legs have been committed, set M = AL, otherwise 
' 

ser M, = A. 
Carry out substeps 1 thru 4 of Step 5 for each of the 


committed arcs and legs. 
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5. Block paths which are not allowed (i.e., those left- 
hand nodes encountered on this branch of tree are 
forbidden nodes). 

6. Carry out Step 6 substeps 1 and 2. 


7. Label X with W(X) =g ali, k) summed over k for 


de 
the uncommitted legs. 
SearcO.1O Oley 6 . 
Step 10: 
Determine complete route which has been found. 
1. Arrange the committed arcs and legs to determine 
missing leg and arc on this leg. 
2. Make last Y node non-terminal since a route was 
determined. 
3. Set Zo = W(Y). Go to Step 8, substep 2. 
End of Algorithm 


A flow chart of the algorithm is in Figure 2. 


io 





FLOW CHART OF ALGORITHM 


START Step 8 
Btn ae i wee ee “7 














Set Ak = My for all k. no. of legs 
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Step 2 t 
7 | 
NO { 
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Step 3 ‘ 
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extension by finding 
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peep 4 matrices Mj; for the 
Label Y by branch under consider- 
W(Y) = W(X) + @(ig, jo:ko) ation 
Step 5 3 es 
Form new set of My by Step ee. | 
restricting arcs and legs Bet Zouy Wily Comp ete 
previously committed in route ate an hereex 
subset under consideration oon pote © 
Step y 
Find minimum element in 
new set of Mk and reduce Step 7 
; Have 
Mk to Mx N-2) legs 
Label Y by been committed 
W(Y) = W(X) + sum of and is 
reducing constants eS Zo 
Figure 2 


16 


POun 









IiI. PROGRAMMING CONSIDERATIONS 


The first decision that had to be made before programming of the 
algorithm began was what computer language would be most appropriate. 
Since one of the primary purposes of this project was to explore the 
feasibility of computerized solutions using the algorithm rather than to 
develop an efficient program for eceeecaie. problems, FORTRAN IV was 
chosen as the language due to its ease of application. 

One of the important factors to consider for computer applications 
is requirement for storage space. The strategy used for selection of 
Ee wbranch point in Step 8 can have a direct effect on storage require- 
ments. There are two basic strategies which may be used: 

Strategy 1: Branch from the lowest bound. This strategy is the 
one used in the original algorithm [Ref. 1] and has the advantage that 
the total computation required to reach optimality is minimized in the 
sense that any branching performed is also that which must be performed 
under any alternate policy. Its primary disadvantage is that no terminal 
nodes are discarded and hence storage requirements may become ex- 
cessive. In addition, it brings Step 9 of the algorithm into play more 
often which requires time to backtrack through the tree and set up the 


matrices for a further branch from the chosen node. 


Senet ecalc here is considered to be when the number of nodes, 
N, is greater than 20. 


Le 





Strategy 2: Branch always from the latest Y node if a complete 
route has not been determined and discard nodes from storage that are 
no longer in contention for branch points or for the optimal route. This 
is known as a "branch to the right" policy. It has as its primary 
advantage that the amount of computer storage required is minimized 
since nodes are discarded when they are no longer required. Also, 
Step 9 of the algorithm will not be called upon as frequently as under 
Strategy |. 

Strategy 1 was originally employed, but for the few test cases 
considered, the number of iterations and time required to obtain the 
optimal route was in general greater than that required under Strategy 2 
and hence the program presented uses Strategy 2. 

As mentioned inReference 1, a very useful feature of this routing 
algorithm is that one can stop at any point after the first complete route 
has been determined and have a feasible tour, although it may not be 
optimal. In the computer application of the algorithm, it may be the 
case that sufficient storage space or time required to reach the optimal 
solution may not be available. Hence, if one is willing to accept a 
suboptimal solution such as a solution below a given cost, this given 
cost could be input to the program and as soon as a Solution that has a 
cost less than this amount has been found, computation can be halted. 
This may be found to be extremely useful when dealing with large-scale 
problems where to pay for sufficient computer time to reach the optimal 
solution might be prohibitive [Refs. 1 and 5}. Note that in test problem 
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Number 11, a solution within 4% of the known optimal solution was 
obtained in a very short period of time, but that nearly 300 minutes 

and 25,000 iterations later, the same solution was found and the optimal 
route had still not been located. 

Although Reference 1] gives a modification to the basic algorithm 
for symmetric matrices, the modification was not incorporated in the 
program presented here. 

For test problems 1 - 10 presented in Section V, storage require- 
ments did not become excessive as will be discussed in more detail 


under Section VI on computational results. 
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IV. THE COMPUTER PROGRAM 


The computer program is entirely integer in nature except for the 
variables used in conjunction with the timing routine. A detailed 
description of the major variables used in the program may be found in 
Appendix D. Originally, the program was compiled using the FORTRAN 
G-level compiler and consisted of a main program where the major 
portion of all iterations was accomplished, and two subroutines, one 
used for Step 5 of the algorithm and the Pe for OULpUe. 

It was noted that the FORTRAN H-level compiler generated an 
object code which was superior to the G-level compiler, particularly 
for extensive looping and arithmetic operations which were present in 
this type of program. An attempt was made to compile the identical 
program using this H-level compiler but the program size combined with 
its complexity was too large for the compiler to accommodate. At this 
point, the program was broken up into a main program and eight sub- 
routines, all of which the H-level compiler could handle. The computer 
program flow along with a brief description of the subroutines is illus- . 
trated in Figure 3. 

Maximum storage utilization was attained by specifying that 
nearly all variables be INTEGER*2. This meant that the principal 
iteration information for the tree which was maintained for purposes of 
being able to branch from any node was limited to numbers less than 


or equal to 32,767. This limitation applies to bounds on nodes and 


Z1 





number of iterations; hence node numbers, since node numbers are 
directly related to iterations. All right-hand nodes are labeled by 
positive numbers which identify them with the iteration on which they 
were Obtained and likewise, left-hand nodes are labeled by negative 
numbers. 

Another limitation of the program as presented is that the number 
of nodes be equal to or less than 20. The number of tours which can 
be expected to be obtained is limited to 30. The first tour is obtained 
by branching to the right immediately until a complete tour is specified 
which takes place on the (N-2)-nd iteration. All future tours must have 
cost equal to or less than the previous tour or they are not considered 
Or counted as a tour for the purposes of the program. 

All of the limitations discussed are limits of the computer program 
as presented and may be easily modified by changing the appropriate 
DIMENSION statements. Iteration information contained in the matrices 
YTAB and YBTAB which is used for constructing the branch point becomes 
the primary storage-limiting factor when the number of iterations is 
expected to be in the thousands. For 150 iterations, which was used 
for the first eight test problems, the entire program required 114,000 
(114K) bytes of storage. Each increment of 100 iterations above the 
150 used requires 1.8K bytes of storage and therefore 2500 iterations 
as used for test problem Number 9 required 42K more bytes which led 


to a program size of 156K. 
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For the typical traveling salesman problems discussed in the 
next section, the optimal route as expressed by the computer output 
has been adjusted to reflect the actual route which excludes the dummy 
node (N+1l). Typical computer solution output for both a sequence- 
dependent case and a typical traveling salesman case may be found 
ey Appendix B. 

A timing routine used in Reference 4 is included in the program 
for purposes of obtaining eel problem solution times which excludes 
all input and output buffering times. 

The program follows the algorithm step by step. Documentation 
is interspersed throughout to enable a casual reader to understand the 
basic program flow. The entire program may be found in Appendix E. 
Appendix C contains the make up of the computer card deck. 

In order to provide dynamic allocation of storage space based 
upon the number of nodes in a given problem and the number of iterations 
desired, modifications to the basic program presented in Appendix E 
have been provided in Appendix F. Details on the specific changes are 
given in Appendix F. The primary advantage of these modifications is 
that the user does not have to change all of the variable specifications 
and dimension information cards in the 8 primary routines each time 
different values for N and ITS are used (N is the number of nodes; ITS 
is the number of iterations desired). Only the appropriate job control 
language (JCL) card which specifies the storage and time requirements 


for the execution of the program must be changed. 
Z3 





Vee ol PROBLEMS 


A. SEQUENCE DEPENDENT PROBLEMS 

The first three test cases were problems whose description places 
them into the class of sequence-dependent routing problems. Problems 
1 through 3 were taken directly from DeHaemer [1]. Problems 1 and 2 
consisted of matrices which were asymmetric. In problem 3, all 
matrices were Symmetric. As was noted in Section III, the computer 
program does not provide for special treatment of symmetric matrices, 
but it was desirable to include symmetric matrices as test problems. 

Rroplem No.) 

Suppose an itinerant salesman must be routed so that his 
travel expenses are minimized while visiting 5 different cities. He 
must complete a leg of his route on each of 4 consecutive days. Travel 
expenses vary aS a function of the day on which the travel occurs. At 
certain times, no public transportation is available and the costs reflect 
the price of the available charter transportation. All possible costs 
have been tabulated for each of the 4 traveling days and are presented 


im Figure 4. 
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Problem No. 1: Initial Set of Cost Matrices 


Figure 4 
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Froblém No. 2 
This problem has the same framework as problem 1 except 
that there are 6 different cities and thus there are 5 legs of the route. 
The matrices of all possible costs are tabulated in Figure 5. 
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Problem No. 2: Initial Set of Cost Matrices 


Figure 5 


ProblemeNo..3 
Figure 6 contains a set of four symmetric cost matrices 


from which a minimal cost route is desired. 
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Problem No. 3: Initial Set of Cost Matrices 


Figure 6 


These first three examples are discussed in more detail along 
with sample calculations in Ref. 1. 

It would have been desirable to have larger test problems for 
which an optimal route was known. In order to avoid the lengthy hand 
computations involved in the setup and solution of a larger problem, 
it was thought that the typical closed-loop traveling salesman problems 
which have known optimal solutions and are abundant in the literature 


could provide additional test cases. 


B. TRAVELING SALESMAN PROBLEMS 

By appropriate modification of the input data, the typical closed- 
loop traveling salesman problem (hereafter referred to as TSP) can be 
solved by the program. It was necessary that the problem be structured 
in a manner such that the route would be closed as opposed to the open- 
ended route determined by the algorithm, visiting each node exactly 
once. Since the optimal route in a TSP is independent of the starting 
node, it was observed that the addition of one dummy node and hence 


one dummy leg attained the desired results. This can best be illustrated 


by an example. 
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Suppose the following matrix of costs between 4 nodes was 


given: 


Mm GW He 





It is assumed, as is usually the case in the TSP, that the matrix is 
the same for each leg. Consider the following set of four matrices 
which have one additional dummy node (node 5) besides the original 


4 from above. 


say _ mM ~ 





1 

Z N=5 

5 

4 No. of legs = 
3) N-1 = 4 


The number of nodes is now 5 and hence 4 legs are required to complete 


a route. Matrix M, is used to force the algorithm to choose leg one 


with an arc leading from node 1, to one of the other original nodes, 
nodes 2, 3, or 4, since all other arc choices on the first leg have 


prohibitive costs associated with them. Matrix M, is a dummy leg 


which is used to form a closed-loop. The only entries of significance 


4 
in M, are those in the last column, column 5. These mio values 


represent the costs of going from any node to node 1, since leg one 
began with an arc leading from node 1. Since the only "acceptable" 


] =5, =2, =] .. = oo fori=1and 5, 
values are M,. 5 Mae 2, and Mas as Mo 
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the optimal route will be forced to close on node 1 as desired. Matrices 
M, and M, are identical and are designed to prevent any arc from 
Originating at node 1 or node 5 and to prevent any arc from terminating 
at node 1 or node 5, and therefore rows 1 and 5 and columns 1 and 5 
have infinite values. Note that the dotted lines in ae and M, contain 
the original matrix less row 1 and column 1, as illustrated by the 

dotted lines in the original matrix. 

The general pattern which emerges is that the matrix for leg l 
would contain all infinite values except for those arcs leading from 
node 1 to all the other original nodes. The last matrix would contain 
all infinite values except for the last column which would be the same 
as the first column of the original matrix with the infinite value below 
it. The intermediate matrices would be the same as the original matrix 
less row 1 and column 1 with an entire border of infinite values added 
to them. 

With the above modifications, the following traveling salesman 
problems were solved as though they were sequence-dependent routing 
problems. (Only the origina! matrix is given.) 


Problem No. 4 [Ref. 6] 
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Problem No. 4: Initial Cost Matrix 


Figure 7 
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Problem No. 5 [Ref. 6] 
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Figure 8 


Problem No. 6 [Ref. 5] 
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Problem No. 7 [Ref. 2] 





79° -x 38 
Seen 2-56 49 77 7249 23° x 


Some, 4a 30) Org 


— 
OMOOAnN DN BWN FY 


Problem No. 7: Initial Cost Matrix 


Figure 10 
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Problem No. 8 [Ref. 2] 
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Problem No. 8: Initial Cost Matrix 


Figure Il 


Problem No. 9 [Ref. 3] 
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Problem No. 9: Initial Cost Matrix 


Figure 1Z 


30 





Problem No. 10 [Ref. 7] 
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Problem No. 10: Initial Cost Matrix 


Figure 13 


Problem No. 11 [Ref. 2] 
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VI. COMPUTATIONAL RESULTS 


Table I presents Summary Statistics for the eleven test problems 
considered. Optimal routes obtained verified the known results which 
are in the respective references from which the problems were taken, 
with the exception of test problem Number 7. Reference 2 indicates 
that the optimal route for this problem is as specified in the notes for 
Table I with an optimal route COSt Of 33. This program obtained the 
optimal route indicated in the table with a route cost of 28 which is 5 
cost units superior to the previous known result. 

The type of problem is either sequence-dependent (SD) or 
traveling salesman problem (TSP) as discussed in Section V. The 
number of complete tours obtained by the program is significant in that 
after the first tour is obtained by branching only to the right, a suc- 
ceeding tour found must have a cost equal to or less than the best tour 
located so far in the computational procedure. It is somewhat repre- 
sentative of the "speed" of convergence towards the optimal solution. 
The number of iterations required is actually the number necessary to 
verify that the best route found by the program is the optimal route. 
The iteration number on which the optimal route is located is in general, 
far lower than the total number of iterations required for verification 
(note test problems Numbers 9 and 10). 

Test problems Numbers 4, 5, and 10 have alternate routes 


indicated, but these routes are mirror images of one another and hence 
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are identical. This fact is due to the symmetric nature of the input 
matrices combined with the fact that the matrices are the same for all 
legs of the route excluding the dummy legs. It would be desirable to 
eliminate consideration of any future route which would be an image of 
a route previously located, but this feature was not incorporated into 
the program. Yor the sequence-dependent symmetric case, test problem 
Number 3, only a single route is found as the matrices for each leg are 
symmetric, but different for each leg. 

Since only a few cases were presented, it would be difficult to 
attempt to draw any conclusions with respect to expected time required 
for,solution of a problem of given size. However, it was observed 
that the time required for a solution rises rapidly as the number of nodes 
increases as discussed in Reference 2. The computer storage require- 
ment for test problems 1 through 9 was a moderate 154K, but problem 
Number 10 required 392K. Test problem Number 11 was run for approxi- 
mately 300 minutes and 25,000 iterations which required 546K bytes 
of storage and the optimal solution was never reached. This matrix is 
symmetric and hence the number of iterations could be reduced by 
Lacing this tact Into account. 

Test problems 7 and 8 terminated in just a few iterations but the 
zeroes in the matrix were placed somewhat strategically. In problems 
9 and 10, the entries in the matrix are nearly all two digit numbers 
which are close to each other in magnitude and hence there is no clear- 
cut minimum route as in problems 7 and 8, and thus the number of 


iterations runs up into the thousands. 
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VII. CONCLUSIONS 


The branch-and-bound algorithm and the computer program 
presented can successfully find the optimal route for a variety of 
sequence-dependent routing problems when the matrices of all possible 
costs for each leg of the route are known. 

Although it is admitted that the computer program, as written 
in FORTRAN IV, may not be the most efficient for large-scale problems 
due to storage requirements and processing time, it does provide a 
basis for further programming effort using this algorithm. Although no 
attempt was made to delete nodes from storage once the node bound 
was Observed to be above the current least upper bound on a complete 
route, larger scale problems would demand such reduction. 

In the case of symmetric matrices, a programming method must 
be devised to delete consideration of arc (j,i) when arc (i,j) has been 
committed to a leg as this just leads ta excessive computation and 
excessive iterations. It is recommended that a lower-level language, 
such as Assembly Language, be utilized to improve efficiency with 
respect to both time and storage requirements since the algorithm 


deals primarily with integer arithmetic operations. 
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APPENDIX B 


CASE NOw 2 

EXAMPLE 2 FROM REFERENCE 1 

NUMBER OF NODES = 6 

NUMBER OF LEGS = 5 

myPE PROBLEMS SEQUENCE-DEPENDENT 


MATRIX Ml MATRIX M2 
mer 40 24 32 28 12 at el eee 7S 
Borers 20 26 4 32 Q*x*x 5 9 1 8 
Bom a2 Xe 8) 16 16 6 8*** 2 4 & 
ead 20%4% 24 16 32 5 5***¥ 6 | 
Bese le ort 68 Za Ce ne ee 
Memz¢ V6 26 12**x BG ea bs Sse 

MATRIX M4 MATRIX M5 
Sooo Oe 2 1G 14 6 Poros) 40555 Ib 
Poa ee lO es 2 16 Gores 2.5 45 5 40 
Penlorrn 4 8 § 30 40*** 10 20 20 
CmlOntOtes 2 8 Poa 2 os ee 30) 520 
416 € 4%*** 4 Or 40515 LO7+* 10 
Syl2 8 10 Gx*x ZO O20 52 Selon = 


CSEESSOLUTIGN ON NEXT PAGE) 


a7 


MATRIX, M3 
“ee 30 18 24 21) 9 
CRS 2 ee ee 
Gr 2aees 8G 12 a2 
SA) Lore 1eri2 
O 299595) 67 eo 
2 LO eo 





FORK ok kokt ok doko ak koko aka ke ak ak ofc ak ak dk ak of ok 


Beeolelt TCWwR NO. 2 £3 DECLARED OPTIMAL 


EEG FROM TO Ces 

i Z 5 4 

Z 5 1 2 

S ) 6 2 

4 6 2 8 

5 5 4 10 

OPTIMAL ROUTE COST = 33 
BK ARC eK AE i a i 2 OK Ck aie ik ie a ae cE ak OE ok ak ok ok ae ok ok 2c 
NUMBER OF ALTERNATE OPTIMAL TOURS = 0 
NUMBER OF ITERATICNS REQUIRED = eZ 
TIME TO CCMPUTE SOLUTICN= Oe 748816 SECONDS 


ITERATION INFORMATION 


YTABLE YBARTABLE 

NODE FROM WY IQ JQ KO TERM WYBAR TERM 
1 0 Zk 2 = 5 6) 20 0 
Z - a7 3 4 I 0 a5 0 
S Z aT 6 2 4 0 45 0 
4 5 a, 4 IE 2 0 S200 0 
5 = 26 Zz 5 i 0 24 0 
6 5 25 5 4 S 0 31 0 
7 6 a 6 3 4 0 oT QO 
8 of a3 5 i eZ 0 B7033 C 
a =o 50 Z 2 2 0 ett 0 
LO 9 ai 3 4 5 0 a 0 
i = 0 34 3 4 S 0 34 0 
12 =o 37 2 5 4 0 29 0 
13 SZ 41 2 5 i 0 30 0 
14 =13 at S 4 1 0 50 0 
P 14 34 4 1 2 QO a2 0 
16 et 31 5 1 1 0 30 0 
Li 16 47 3 4 5 0 41 0 
18 =15 aD 4 6 2 6) S2 0 
rg =16 41 EI 4 i 0 30 0 
20 =18 oy k 4 2 2 0 34 0 
Zk =19 32 5 6 1 0 34 0 
ee a 59 S 4 5 0 oil 0 
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CASE NG. 6 

eee eis euM ARUICEE SY LITTLE AND OTHERS IN OR JOURNAL 1963 
NUMBER OF NGEES = 7 

NUMBER OF LEGS = 6 

Peer ROBLEM: STRAVELING SALESMAN CLOSED-LOOP 

foelRlCes ARE SAME FOR LEGS 2 THRU (N-2) AND ARE AS FOLLOWS: 


I/J= 1 2 3 4 5 6 qT 
1 Se ooo 9S99 9999"9999 
2 oo ago 16 if 30 Coo 
2) e779 1290999 35 5 Ono 799 
4 ooCo ie Zon 9799 18 Domo oo 
5 oe 46 on 48° 9599 Seo 29 
6 2309S 5 5 2 Seo oe oo 
q Sei oS 998997 9595 9999 9999 


Bok CtOl a i tok kak dokok skiaiok datctok sak ak ak ak aka ake ako fe ak 


Beas tBEe TOWR NO. 3 1S DECLARED OPTIMAL 


EEG FROM TO CEST 

1 1 4 16 

2 4 3 25 

3 3 5 5 

4 5 6 5 

5 6 Z 5 

6 2 1 cf 

OPTIMAL FOUTE COST = 63 
FEE AE A IK FR EE KA OE RK CE OK OK AC i le Ae He CK OE AE OK OK 
NUMBER OF ALTERNATE OPTIMAL TOURS = 0 
NUMBER OF ITERATIONS REQUIRED = 46 
Thee 8 COMPUTE SOLUTION= Z2<023424 SECONDS 
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ITERATION INFORMATION 
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KQ TERM 


OTO MMA ANDO MAILAM OILS OMOM MFA OSU NOMOEMOMOR NNT OW OWN O 
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PeenilOlx © 


COMPOnomMiIengOor COMPUTER CARD DECK 


CONTROL CARDS oy 


DATA DECK 


CONTROL CARDS i, | 


ASSM. SOURCE DECK 


CONTROL CARDS DZ) | 


“ORTRAN SOURCE DE Lo 


CONTROL cmp 








DATA DECK MAKEUP 





4 
Card Type 1: 
XXXX Pirst card in 
Variable NGCASE Data Deck 
Format 14 
Card Type 2: 
wR Second card in Data 
Variable Nene ioe FT LE) Deck and first card 
Format 14 ik 16 17A4 of each succeeding 
. case 
Card Type 3: 
: Third card on until all matrices 
Variable 
: M(1,1 /A)M(1, 2, ae have been defined. N(N-1) 
ormat 
2014 cards for each case; input 





matrix for leg 1 first, then 
leg 2, etc., row by row. 


Note: All values are integers and must be right-justified in format 
field specified. 
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APPENDIX D 


DESCRICTIGNNOR VARTASLES USED IN PROGRAM 


kK RK KK KK RK KK OK KK KK KK KK KK KK KOK K OK K 
PROGRAM CONSISTS GF ALL INTEGER VARIABLES EXCEPT TIMEX 
WHICH IS USED IN CONJUNCTION WITH THE TIMING ROUTINE 
PROGRAM LIMITATIONS : 20 NODES TOTAL INCLUDING THE 
AUGMENTED NODE 3 NUMBER OF ITERATIONS IS LIMITED TH 
hotMeeR SPECIFIED BY THE FIRST INDEX OF VARIABLE MATRICES 
Via oeaANDe YSTADb LN THE DIMENSION STATEMENTS AND MU DE 
EOUML TO OR LARGER THAN THE LARGEST VALUE OF THE VARIABLE 
BeoeTrOR ANY “DATA SseE?r DIN THE DATA DECK 

kK OK RK KK KK KK KK KK KK KOK OK K KR KR OK OK OK OK OK 


INPUT DECK REQUIREMENTS 3 CC = CARD COLUMN 


CARD 1: FORMAT (14) Cer 
NCASE=NUMBER OF CASES To BESPROCESSED ON) THIS RUN 


CARD 2: FORMAT(14,12,16,17A4) 
N=NUMBER CF NODES (FORMAT 14) C 


C 
ALT KE—-tea Ee ENTRIES IN MATRIX ARE SA 
ad NTRIES IN MATRIX ARE CI 
( 
kK 


nz -e 


le) CC 5,6 


UBER one TEKAT TONS SDESTRED(FORMAT 16) 
6) Cera iz 


IF 
EG 
FORM 
11S = Mae iy 
FORM 
) 


0 


= 

A 

UM N 

( AT I 

wiTeeC eee noING FOR EACH INDIVIDUAL PROBLEM 
(FORMAT 17A4) CE= 13-80 


) 

MATRICES ARE 
ECOND LEGs EC) 
nd -JUSTIFLED 


G> MMe 


KK KK OK KR KK KK KK KK OK KKK KK Ok KK KK 


ASE = SE HipmeASse Sev URE. PROCESSED ON ONE COMPUTER 


= NUMBER OF NODES 
= MAXIMUM NUMBER OF ITERATIONS DESIRED 


CpitmeeOoler TS SEQUENCE DEPENDENT TYPE PROBLEM 
lr nAVvEMENGSSALESMAN TYPE PROBLEM 


= N-l = NUMBER OF LEGS FOR ROUTE BETWEEN N NODES 
BECREOw—3—=2 = NUMBER OF LEGS REQUIRED TQ DETERMINE ROUTE 


COSWOKI==—"COST GFE GOING FROM NODE FM(K) TO NODE TOCK) 
ON K=TH LEG GF ROUTE 


TCOST(TOUR) = TOTAL COST OF TOUR NUMBER (TOUR) 
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BEST(K,J) = MATRIX CONTAINING BEST TOUR AT ANY STAGE OF 
SUeCCmGON Ar NER FIRST SUBOPTIMAL TOUR HAS BEEN 
PCUND @eK=LEG OF ROUTE) 
J— le oeeeo Cr ROUTE 
=2 IS NODE FROM WHICH LEG K BEGINS 
=Se le 9NODOE WHICH ENDS LEG K 
=4 IS THE COST TO GO FROM J=2 TO J=3 
BESIUN, 1) - NUMBER OF LEAS! COST TOUR DETERMINED AT ANY 
BerttieseteR FIRST TGUR IS LOCATED 
BEST(N,2) = CCST OF TOUR NUMBER BEST(N,1) 
LEGCOM(K) = K IF LEG COMMITTED 
= Om lpeee Go UNCOMMITTED 
FM(K) = NODE OF DEPARTURE ON K-TH LEG OF ROUTE 
TK) —sNODEsGrerkear VAL ON K-TH LEG OF ROUTE 
ARCCOM (I,J) = fee IF NEITHER I NOR J ARE ON A COMMITTED 
=e @ieeeiider NODE f OR NODE J IS ON A 
COMMITEED LEG 


Site — SiEP NURBERSOE ALGORITHM 
ITER = ITERATICN NUMBER 


TOUR = NUMBER CF TOUR FOUND BY ALGORITHM, EACH TOUR 
HAVING A COST WHICH IS LESS THAN OR EQUAL TO THE 
PRECEEDING TOUR 

M(IlyJyK) = WORKING SET OF MATRICES 

= COST (OR OTHER VARIABLE TO BE MINIMIZED) OF 
GOING FROM NODE I TO NODE J ON K-TH LEG GF ROUTE 
A(I;J;K) = GRIGINAL M(1,J,K) = PERMANENT FILE OF ALL 
INPUT MATRICES 
MINEL(K) = MINIMUM ELEMENT IN MATRIX K WHEN LEG K TS 
UNCCMMITTED EXCLUDING ROWS AND/OR COLUMNS 
ASSOCIATED WITH NODES ON COMMITTED LEGS 

MIN(K) = CURRENT MINIMUM ELEMENT IN MATRIX K WHEN LEG K 

1S UNCOMMITTED (USED DURING SEARCH FOR MINEL(K)) 

IK(K) = ROW CONTAINING MINEL(K) 

JK(K) = COLUMN CONTAINIMG MINEL(K) 

THETA = MAXIMUM OF THE SECOND SMALLEST ELEMENTS IN ALL 

PESMRIGTED MATRICES FOR UNCOMMITTED LEGS 


MAX EEe—-sGURRENT THETA IN THE DO-LOOP 

MAXLEG = LEG FROM WHICH THETA WAS OBTAINED 

IO = IK(MAXLEG) 

JO = JKCMAXLEG) 

PEGe— NCOM — CURRENT NUMBER OF LEGS COMMITTED 

WX=THE LOWER BCUND LABEL ATTACHED 10 THE TREE FOR NODE X 
Wry=(HE EOWER BCUND LABEL ATTACHED 10 THE Y NODE OF TREE 


WYBAR = THE LOWER BOUND LABEL ATTACHED TO THE YBAR NODE 
OR stHit TREE 
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Pile N DE F 


MODIFICATIONS TO COMPUTER PROGRAM FOR 
DYNAMIC STORAGE ALLOCATION 


The following modifications to the basic program presented in 
Appendix E will provide dynamic storage allocation based on the number 
of nodes (N) and the maximum number of iterations (ITS) desired for each 
case in the computer data deck: 

Ie The Assembly Language listing on the following pages 
should be inserted at the very front of the computer source deck. 

Zn A new main program which is found after the Assembly 
Language listing replaces the original main program. The original main 
program becomes SUBROUTINE START and is listed here. after the new 
main program. 

oF All other subroutines remain the same as before with the 
exception of the variable type specification statements, DIMENSION 
statements, and COMMON statements. These 6 statements as found 
in the new SUBROUTINE START must be used in all the old FORTRAN 
subroutines except SUBROUTINE TIMEIT which does not change. 

4A. The CALLS for the subroutines and the SUBROUTINE definition 
cards must be the same as before with the added arguments as found in 
tremew cUBROUTINE START definition card. 

Oe The JCL is included as a guide and is unique to the 
IBM 360 Model 67 Computer System installation at the Naval Postgraduate 


School. The only card which is required to be changed on various 
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runs in the EXEC card. It must contain a region for the GO step which 

is large enough to handle the case with the maximum number of iterations 
and specify time for the GO step large enough to accommodate the expected 
running time for all cases in the data deck. 


The makeup of the revised computer deck is on the following page. 
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NEW MAIN PROGRAM FOR DYNAMIC ALLOCATION OF STORAGE SPACE 
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rrr 
4a 
am ae, om 
CO = 
DARD 


Naa 


READ(5,1) NCASE 
DO 10 AA=1;,NCASE 
“READ INPUT PARAMETERS 
MoM mene ITS, (TITLECI);1=1;17) 
CALCULATE AMOUNT OF STORAGE REQUIRED FOR VARIGUS ARRAYS 


NNNMI2 = N*NK*(N-1) *2 
NNNMI4=NNNM12*2 
NES = 15 
N2 = N¥2 
N4&4 = N*4 
NN2 = N*¥N2 
N42 = N4*2 
Iv¥S72 = ITS*14 
ITS22 = ITS*4 
CALL ASSEMBLY LANGUAGE PROGRAM FOR CBTAINING STORAGE 
CALL GETARYCERROR, START, NI Sa NNNM14»N4,N4_.NNNMI2~N2yN2,y 
IN2sN2,N2,NNZyN42,TTS72,1TS229N2,N2) 
[RPOERROR CII ONE.BLNK) GO TG 20 
10 CONTINUE 
GO TG 30 
20 WRITE(6,25) ERROR 
S0)S 1G 
END 
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